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Abstract 

We study the a priori semimeasure of sets of Pg-random infinite sequences, where Pg is a family 
of probability distributions depending on a real parameter 9. In the case when for a computable 
probability distribution Pg an effectively strictly consistent estimator exists, we show that the 
Levin's a priory semimeasure of the set of all Pg-random sequences is positive if and only if 
the parameter 9 is a computable real number. For the Bernoulli family Be, we show that the 
a priory semimeasure of the set Uglg, where Ig is the set of all B^-random sequences and the 
union is taken over all non-random 9, is positive. 



1. Introduction 

We use algorithmic randomness theory to analyze "the size" of sets of infinite sequences 
random with respect to parametric families of probability distributions. 

Let a parametric family of probability distributions Pe, where 9 is a real number, be 
given such that an effectively strictly consistent estimator exists for this family. The 
Bernoulli family with a real parameter 9 is an example of such family. Theorem 1 shows 
that the Levin's a priory semimeasure of the set of all Pg-random sequences is positive 
if and only if the parameter value 9 is a computable real number. 

We say that a property of infinite sequences has no "empirical meaning" if the Levin's 
a priory semimeasure of the set of all sequences possessing this property is 0. In this 
respect, the model of the biased coin with "a prespecified" probability 9 of head is 
meaningless when 9 is a noncomputable real number; noncomputable parameters 9 can 
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have empirical meaning only in their totality, i.e., as elements of some uncountable sets. 
For example, i-g-random sequences with noncomputable 9 can be generated by a Bayesian 
mixture of these Pg using a computable prior. In this case, evidently, the scmicomputable 
semimeasure of the set of all sequences random with respect to this mixture is positive. 

We give in Appendix A the simple proof of our previous result (formulated in Theo- 
rem 3) which says that the Levin's a priory semimeasure of the set of all infinite binary 
sequences non-equivalent by Turing to Martin-L6f random sequences is positive. In par- 
ticular, these sequences are non-random with respect to each computable probability 
distribution. 

We use this result to prove Theorem 4. This theorem shows that a probabilistic machine 
can be constructed, which with probability close to 1 outputs a random ^-Bernoulli 
sequence such that the parameter 9 is not random with respect to each computable 
probability distribution. This result can be interpreted such that the Bayesian statistical 
approach is insufficient to cover all possible "meaningful" cases for ^-random sequences. 

2. Preliminaries 

Let S be the set of all finite binary sequences, A be the empty sequence, and Q, be the 
set of all infinite binary sequences. We write x C y if a sequence y is an extension of a 
sequence x, l(x) is the length of x. For any u £ 0, v n = u)\ . . . to n . A real- valued function 
P(x), where x £ S, is called semimeasure if 



for all x, and the function P is scmicomputable from below; this means that the set 
{(r, x) : r < P(x)}, where r is a rational number, is recursively enumerable. A definition 
of upper semicomputability is analogous. 

Solomonoff proposed ideas for defining the a priori probability distribution on the 
basis of the general theory of algorithms. Levin [3,15] gave a precise form of Solomonoff 's 
ideas in a concept of a maximal semimeasure semicomputable from below (see also Li 
and Vitanyi [7], Section 4.5, Shen et al. [10]). Levin proved that there exists a maximal 
to within a multiplicative positive constant factor semimeasure M semicomputable from 
below, i.e. such that for every semimeasure P semicomputable from below a positive 
constant c exists such that the inequality 



holds for all x. The semimeasure M is called the a priory or universal semimeasure. 

For any semimeasure Q, its support set Eq is a set of all infinite sequences u> such that 
Q(u n ) > for all n, i.e., Eq = Uq( x)>0 IV 

A function P is a measure if (1) holds, where both inequality signs < are replaced on 
=. Any function P satisfying (1) (with equalities) can be extended on all Borel subsets 
of Q if we define P (T x ) = P(x) in O, where x £ E and T x = {oj £ Q : x £ oj}; after that, 
we use the standard method for extending P to all Borel subsets of ft. By simple set in 
f2 we mean a union of intervals T x from a finite set. 

A measure P is computable if it is, at one time, lower and upper semicomputable. 



P(A) < 1, 
P(xO)+P(xl) < P{x) 



(1) 



cM(x) > P(x) 



(2) 
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For technical reasons, for any semimeasure P, we consider the maximal measure P 
such that P < P. This measure satisfies 

p(x) = mf p (y)- 

In general, the measure P is noncomputable (and it is not a probability measure). By 
(2), for each lower semicomputable semimeasure P, the inequality cM{A) > P(A) holds 
for every Borel set A, where c is a positive constant. 

In the manner of Levin's papers [4-6,15] (see also [13]), we consider combinations of 
probabilistic and deterministic processes as the most general class of processes for gener- 
ating data. With any probabilistic process some computable probability distribution can 
be assigned. Any deterministic process is realized by means of an algorithm. Algorithmic 
processes transform sequences generated by probabilistic processes into new sequences. 
More precise, a probabilistic computer is a pair (P, P), where P is a computable proba- 
bility distribution, and P is a Turing machine supplied with an additional input tape. In 
the process of computation this machine reads on this tape a sequence uj distributed ac- 
cording to P and produces a sequence uj' = F(uj) (A correct definition see in [4,7,10,13]). 
So, we can compute the probability 

Q(x) = P{uj Eil-.xC F(ui)} 

that the result F(ui) of the computation begins with a finite sequence x. It is easy to see 
that Q(x) is a semimeasure semicomputable from below. 

Generally, the semimeasure Q can be not a probability distribution on fi, since F(uj) 
may be finite for some infinite uj. 

The converse result is proved in Zvonkin and Levin [15]: for every semimeasure Q(x) 
semicomputable from below a probabilistic computer (L, P) exists such that 

Q(x) = L{uj\x C F(w)}, 

for all x, where L{x) = 2~ 1 ^ is the uniform probability distribution on the set of all 
binary sequences. 

Analogously, for any Borel set A C Q consisting of infinite sequences, we consider the 
probability 

Q(A) =L{aen: F(a) e A} (3) 

of generating a sequence weiby means of a probabilistic computer P. Obviously, we 
have cM(A) > Q{A) for all such A, where c is a positive constant. 

Therefore, by (2) and (3) M{x) and M(A) define universal upper bounds of the prob- 
ability of generating x and uj € A by probabilistic computers. 

We distinguish between subsets of £1 of M-measure and subsets of positive measure 
M. If M(A) = then the probability of generating a sequence weiby means of any 
probabilistic computer is equal to 0. 

The simplest example of a set of M-measure is A = {uj}, where u> is a non-computable 
sequence. Indeed, if M{uo} > then there exist a rational r > such that M(u> n ) > r 
for all n. Obviously, there are only finite number of uncomparable strings x such that 
M(x) > r. Then there exists an k such that uu k C x and M(x) > r imply x C uj. We can 
compute each bit of uj by enumerating all such x. 
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The sets of M-measure were described by Levin [4,6] in terms of quantity of infor- 
mation. 

We refer readers to Li and Vitanyi [7] and to Shcn et al. [10] for the theory of al- 
gorithmic randomness. We use definition of a random sequence in terms of universal 
probability. Let P be some computable measure in fl. The deficiency of randomness of a 
sequence well with respect to P is defined as 

where w™ = u>iu>2 ■ ■ ■ u> n - This definition leads to the same class of random sequences as 
the original Martin-L6f [8] definition. Let Rp be the set of all infinite binary sequences 
random with respect to a measure P 

R P = {uj e £1 : d(uj\P) < oo}. 

We also consider parametric families of probability distributions Pg(x), where 9 is a real 
number; we suppose that 9 € [0, 1]. An example of such family is the Bernoulli family 
B e (x) =9 k (l-9) n - k , where n is the length of x and k is the number of ones in it. 

We associate with a binary sequence 9\9i . . . a real number with the binary expansion 
0.#i#2 • • •• When the sequence 9\9i ... is computable or random with respect to some 
measure we say that the number 0.#i# 2 ... is computable or random with respect to the 
corresponding measure in [0,1]. 

We consider probability distributions Pg computable with respect to a parameter 9. 
Informally, this means that there exists an algorithm enumerating all triples (x,ri,r 2 ), 
where x £ S and r\ , r 2 are rational numbers, such that r\ < Pg (x) < r 2 . This algorithm 
uses an infinite sequence 9 as an additional input; if some triple (x, ri, r 2 ) is enumerated 
by this algorithm then only a finite initial fragment of 9 was used in the process of 
computation (for correct definition, see also Shen et al. [10] and Vovk and V'yugin [11]). 

Analogously, we consider parametric lower semicomputable semimeasures. It can be 
proved that there exist a universal parametric lower semicomputable semimeasure Mg. 
This means that for each parametric lower semicomputable semimeasure Rg there exists 
a positive constant C such that CMg(x) > Rg(x) for all x and 9. 

The corresponding definition of randomness with respect to a family Pg is obtained by 
relativization of (4) with respect to 9 

dg(UJ) = sup ■ 



P e (u n ) 

(see also [3]). This definition leads to the same class of random sequences as the original 
Martin-L6f [8] definition relitivized with respect to a parameter 9. 
For any 9, let 

Ig = {uj £ O : dg(cj) < oo} 

be the set of all infinite binary sequences random with respect to the measure Pg. In case 
of Bernoulli family, we call elements of this set 9-Bernoulli sequences. 
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3. Randomness with respect to a parameter family 



We need some statistical notions (see Cox and Hinklcy [2]). Let Pg be some computable 
parametric family of probability distributions. A function 6{x) from S to [0, 1] is called 
an estimator. An estimator 9 is called strictly consistent if for each parameter value 9 for 
Pg-almost all w, 

9(uj n ) -» 9 

as n — > oo. 

Let e and S be rational numbers. An estimator 9 is called effectively strictly consistent 
if there exists a computable function N(e, S) such that for each 9 for all e and S 

P {uj eil: sup \9{uj n ) - 9\ > e} < 6 (5) 

n>N(e,S) 

The strong law of large numbers Borovkov [1] (Chapter 5) 



shows that the function 9{lo u ) = ^ ^ is a computable strictly consistent estimator 
for the Bernoulli family Bg. 

Proposition 1 For any effectively strictly consistent estimator 9, 

lim 9(w n ) = 9 

n— >oo 

for each to G Ig . 

Proof. Assume an infinite sequence w be Martin-L6f random with respect to Pg for some 
9. 

At first, we prove that lim 9(iv n ) exists. Let for j = 1, 2, . . ., 

Wj = {a G ft : (3n,fc > iV(l/j, 2-^' +1 )))|£(a") - ^(a fe )| > 1/j}. 

By (5) for any (9, Pg(Wj) < 2~i for all j. Define = U J>i W j for all i. By definition for 
any 9, Pg(Vi) < 2~ l for all i. Also, any set Vi can be represented as a recursively enu- 
merable union of intervals of type T x . To reduce this definition of Martin-L6f test to the 
definition of the test (4) define a sequence of uniform lower semicomputable parametric 
semimeasures 



2 i P e {x) ifT x <ZV t 
otherwise 



and consider the mixture Rg(x) = ^ in+T) R-6,i{x). 

i—l 

Suppose that lim 9{ui n ) does not exist. Then for each sufficiently large j, \9{uj n ) — 

n — >oo 

9(oj k )\ > 1/j for infinitely many n and k. This implies that oj E Vi for all i, and then for 
some positive constant c, 

M e (u n ) R e (uj n ) 
dg(Lu) = sup > sup . -7 = oo, 

„ „ cP e (w n ) 
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i.e., w is not Martin-L6f random with respect to Pg. 

Suppose that lim 9(ui n ) ^ 9. Then the rational numbers n, r-i exist such that r\ < 

n — >oc 

lim 9(u> n ) < T2 and 9 [r\,r2\- Since the estimator 9 is consistent, Pg{a : n < 

n — >oo 

lim 9(a n ) < — 0, and we can effectively (using 9) enumerate an infinite sequence of 

n — >oo 

positive integer numbers n\ < n 2 < . . . such that for 

W; = L){T X : l{x) > nj, ri < 9{x) < r 2 }, 

we have P e (W<) < 1~i for all j. Define V- = Uf>;Wj for all i. We have P e {V() < 2~* 
and u) G V/ for all i. Then w can not be Martin-L6f random with respect to Pg. These 
two contradictions obtained above prove the proposition. A 

The following theorem generalizes the simplest example of a set of M-measure pre- 
sented in Section 2. It can be interpreted such that P^-random sequences with "a prespec- 
ified" noncomputable parameter 9 can not be obtained in any combinations of stochastic 
and deterministic processes. 

Theorem 1 Assume a computable parametric family Pg of probability distributions has 
an effectively strictly consistent estimator. Then for each 9, M(Ig) > if and only if 9 
is computable. 

Proof. If 9 is computable then the probability distribution Pg is also computable and by 
(2) cM(Ig) > Pg(Ig) = 1, where c is a positive constant. 

The proof of the converse assertion is more complicated. Assume M(Ig) > 0. There 
exists a simple set V (a union of a finite set of intervals) and a rational number r such 
that \M{V) < r < M(Ig U V). For any finite set X C S, let X = U xeX T x . 

Let n be a positive integer number. When we compute a rational approximation 9 n of 
9 up to ^ as follows. Using the exhaustive search, we find a finite set X n of pairwise 
incomparable finite sequences of length > N(l/n, 2~ n ) such that 

x n c v, M( - x 1 > r < 

xEX n 

\e{x)-e{x')\<^ (6) 

for all x,x' G X n . If any such set X n will be found, we put 9 n = 9(x), where x is the 
minimal element of X n with respect to some natural (lexicographic) ordering of all finite 
binary sequences. 

Let us prove that for each n some such set X n exists. Since M(Ig <1V) > r, there exists 
a closed (in the topology defined by intervals r^) set E C I g n V such that M(E) > r. 
Consider the function 

f k (u>) = inf{n : n > k, \9(w n ) - 0\ < ^}. 

By Proposition 1 this function is continuous on and, since the set E is compact, it is 
bounded on E. Hence, for each k, there exists a finite set X C 5 consisting of pairwise 
incomparable sequences of length > k such that E C X and \9{x) — 9(x')\ < ^ for all 
x,x' G X. Since E C X, we have ^ M{x) > r. Therefore, the set X n can be found by 

exhaustive search. 

Lemma 1 For any Borel set KCfi, M(V) > and V C Ig imply Pg{V) > 0. 
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Proof. By definition of Mg each computable parametric measure Pg is absolutely contin- 
uous with respect to the measure Mg, and so, we have representation 

Pe{X) = J ^-(w)dM e (w), (7) 
x 

where J-j^M is the Radon-Nicodim derivative; it exists for Mg-almost all oj. 
By definition we have for Mg-almost all u) G Ig 

= lim > fiminf ^K) > C e , u > 0. (8) 

dMg n-*oo Mg ra— >oo Mg 

By definition cgMg(X) > M(X) for all Borel sets X, where eg is some positive constant 
(depending on 9). Then by (7) and (8) the inequality M{X) > implies Pg{X) > for 
each Borel set X. A 

We rewrite (5) in the form 

E n = {weSl: sup \6(w N )-6\>^-}. (9) 

Af>A r (l/(2n),2-") Zn 

By definition Pg{E n ) < 2~ n for all n. We prove that X n % E n for almost all n. Suppose 
that the opposite assertion holds. Then there exists an increasing infinite sequence of 
positive integer numbers n\,n2 ■ ■ ■ such that X ni C £"„. for all i — 1,2,.... This implies 
Pe(X n J < 2~ ni for all i. For any fc, define Uk = Lii>kX ni . Clearly, we have for all 
k, M(Uk) > r and Pg{U k ) < £ 2"™' < 2-™ fc+1 . Let U = f\U k . Then P {U) = and 

i>k 

M(U) >r> \M{V). From f/CVand M(I e DV) > \M(V) the inequality M(I e nU) > 
follows. Then the set 1$ H U consists of Pg-random sequences, Pg(Ig fl U) = and 
M(/e n [/) > 0. This is a contradiction with Lemma 1. 

Assume X n % E n for all n > no- Let also, a finite sequence x n G X„ is defined such 
that 

r Xn n (n \ E n ) ± 0. 

Then from l(x n ) > N{^,2~ n ) the inequality 



1 K*n) 



1 

2n 



follows. By (6) we obtain \9 n — 6\ < ^. This means that the real number 9 is computable. 
Theorem is proved. A 

Let Q be a computable probability distribution on 9s (i.e., on the set fl). Then the 
Bayesian mixture with respect to the prior Q 



P{x) = J Pg(x)dQ(9) 



is also computable probability distribution. 

Recall that Rq is the set of all infinite sequences Martin-L6f random with respect to a 
computable probability measure Q. Obviously, P(Ug e R /Q Ig) — 1, and then M(Ug & R Q Ig)) > 
0. Moreover, it follows from Corollary 4 of Vovk and V'yugin [11] 
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Theorem 2 For any computable measure Q, a sequence u is random with respect to the 
Bayesian mixture P if and only if uj is random with respect to a measure Pg for some 9 
random with respect to the measure Q; in other words, 

Rp = lig e n, Q Ig. 

Notice that each computable 9 is Martin-L6f random with respect to the computable 
probability distribution concentrated on this sequence. 

4. Randomness with respect to non-random parameters 

We show in this section that the Bayesian approach is insufficient to cover all possible 
"meaningful" cases: a probabilistic machine can be constructed, which with probability 
close to one outputs a random ^-Bernoulli sequence, where the parameter 9 is not random 
with respect to each computable probability distribution. 

Let V{Q) be the set of all computable probability measures on and let 

be the set of all sequences Martin-L6f random with respect to computable probability 
measures. We call these sequences - stochastic. Let S c be a complement of S - the set of 
non-stochastic sequences. 

An infinite binary sequence a is Turing reducible to an infinite binary sequence se- 
quence (5 if a = F(f3) for some computable operation F; we denote this a <t (i- Two 
infinite sequences a and (3 are Turing equivalent if a <t (3 and (5 <t ot. Let 

Cl(S) = {a : 3j3(p £ Sk(3 < T a)}. (10) 

The complement of the set (10), Cl(S) c = O \ Cl(S), consists of sequences non-random 
with respect to all computable probability disributions, i.e., Cl(S) c C S c ; moreover, it 
consists of sequences which can not be Turing equivalent to stochastic sequences. Also, 
no stochastic sequence can be Turing reducible to a sequence from Cl(S) c . 

V'yugin [12], [13] proved that M{Cl{S) c ) > 0. 
Theorem 3 For any e, < e < 1, a lower semicomputable semimeasure Q exists such 
that Q(E Q ) > 1 - e and E Q C Cl(S) c . 

For completnees of presentation we give in Appendix A a new simplified proof of this 
theorem. 

We show that this result can be extended on parameters of the Bernoulli family. 
Theorem 4 Let Ig be the set of all 9-Bernoulli sequences. Then 

M(U 0eCl{sr Ig) > 0. 

In terms of probabilistic computers, for any e, < e < I, a probabilistic machine (L,F) 
can be constructed, which with probability > 1 — e generates an 9-Bernoulli sequence, 
where 9 6 Cl(S) c (i.e., 9 is nonstochastic) . 

Proof. For any e>0,0<e<l, we define a lower semicomputable semimeasure P such 
that 

P(Ueeci(S)cIe) > 1 - e. 
The proof of the theorem is based on Theorem 3. 
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Let Q be the semimeasure defined in this theorem. For any uj ^ Eq we have Q(oj n ) = 
for all sufficiently large n. For the measure 

R~(x) - J Bg(x)dQ(9), (11) 

where Bg is the Bernoulli measure, we have R~(Q) > 1 — e by Theorem 3, and 
-R~( u 6/ec((<s)-M = 0. 

Unfortunately we can not conclude that cM > R~ for some constant c, since the 
measure R~ is not represented in the form R~ = P for some lower semicomputable 
semimeasure P. To overcome this problem, we consider some semicomputable approxi- 
mation of this measure. 

For any finite binary sequences a and x, let B~(x) = (6~) K (1 — 6 + ) N ~ K , where N is 
the length of x and K is the number of ones in it, 0~ is the left side of the subinterval 
corresponding to the sequence a and 9 + is its right side. By definition B~{x) < Bg(x) 
for all 0" <9 < 9+. 

Let e be a rational number. Let Q s (x) be equal to the maximal rational number 
r < Q(x) computed in s steps of enumeration of Q(x) from below. Using Theorem 3, we 
can define for n = 1, 2, . . . and for each x of length n a computable sequence of positive 
integer numbers s x > n and a sequence of finite binary sequences a x _\, a x _2, ■ ■ ■ &x.k x of 
length > n such that the function P{x) defined by 



P(x) = J2B- xi (x)Q s °(a x ,i) (12) 



is a semimeasure, i.e., such that condition (1) holds for all x, and such that 

E ^)>l-e (13) 

l(x)—n 

holds for all n. These sequences exist, since the limit function R~ defined by (11) is a 
measure satisfying i?~(f2) > 1 — e. 

By definition the semimeasure P(x) is lower semicomputable. Then cM(x) > P(x) 
holds for all x G S, where c is a positive constant. 

To prove that P(£l\UgIe) = Owe consider some probability measure Q + > Q. Since (1) 
holds, it is possible to define some noncomputable measure Q + satisfying these properties 
in many different ways. Define the mixture of the Bernoulli measures with respect to Q + 

R+(x) = J B e (x)dQ+(9). (14) 

By definition \ Ugle) = 0. Using definitions (12) and (14), it can be easily proved 

that P < R+. Then P(fl \ U g I ) = 0. By Theorem 3 Cl(S) C ft \ Eq, and then 
Q{Cl{S)) = 0. By (12) we have P(U geClls) I ) = 0. By (13) we have P{Q) > 1 - e. 
Then P(U ge ci(syIe) > 1 - e. Therefore, M(Ug eC i(syIe) > 0. A 
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Appendix A. Proof of Theorem 3 

Recall that Eq is the support set of a semimeasure Q. In that follows we define a 
semicomputable semimeasure Q such that 

- 1) Q{E Q ) > 0; 

- 2) for each u G Eq and for each computable operation F such that F(u) is infinite, 
the sequence F(u) is not Martin-L6f random with respect to the uniform probability 
measure L on Q. 

By Theorem 4.2 from [15] for each computable measure P on fi, there exist two com- 
putable operations F and G such that 

- 3) F(oj) G for each u> random with respect to L, and G(F(uj)) = uj; 

- 4) for each sequence u random with respect to P (and such that P{uo} = 0), the 
sequence G(iv) is random with respect to L. 

By l)-4) each sequence u> G Eq can not be Martin-L6f random with respect to any 
computable probability measure P. 

We will construct a semicomputable semimeasure Q as a some sort of network flow. 
We define an infinite network on the base of the infinite binary tree. This networt has 
no sink; the top of the tree (empty sequence) is the source. 

Each x G 5 defines two edges (x,x0) and (x,xl) of length one. In the construction 
below we will add to the network extra edges (x, y) of length > 1, where x, y G S, x C y 
and y ^ xO, xl. By the length of the edge (x, y) we mean the number l(y) — l(x). For any 
edge a — (x, y) we denote by st(cr) = x its starting vertex and by ter(a) = y its terminal 
vertex. A computable function q(a) defined on all edges of length one and on all extra 
edges and taking rational values is called a network if for all x G S 

E ?w ^ L 

a: st(a)—x 

Let G be the set of all extra edges of the network q (it is a part of the domain of q). By 
q-flow we mean the minimal semimeasure P such that P > R, where the function R is 
defined by the following recursive equations 

R(X) = 1; 

a: ter{a)—y 

for y ^ A. It is easy to see that this semimeasure P is lower semicomputable if q is 
computable. 

A network q is called elementary if the set of extra edges is finite and q(u) = 1/2 
for almost all edges of unit length. For any network q, we define the network flow delay 
function (g-delay function) 

d(x) = 1 — q(x, xO) — q(x, xl). 

The construction below works with all programs i computing the operations Fi(x). 2 We 
define some function p(n) such that for each positive integer number m we have p(n) = m 

2 The existence of the effectively computable sequence {Fi} such that for each computable operation 
F, F = Fi for some i is proved in [9]. 
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for infinitely many n. For example, we can define p((m, k)) = to and p'((m, k)) — k for 
all to and k, where (to, k) is some computable one-to-one enumeration of all pairs of 
nonnegative integer numbers. Then for each step n we compute (i,s) = p(n), where i 
is a program and s is a number (we call s number of a session); so, i = p(p(n)) and 
s =p'(p(n)). 

Let a program i, a number s, finite binary sequences x and y, an elementary network 
q, and a nonnegative integer number n be given. Define B((i, s),x, y, q, n) be true if the 
following conditions hold 

- (i) Kv) =n,xCy, 

(ii) d(y k ) < 1 for all k, 1 < k < n, where d is the g-delay function and y k = yi ■ ■ .yk', 

- (iii) l(Fi(y)) >(x,s). 

Let B((i, s),x,y,q,n) be false, otherwise. Define 

(3{x, q, n) = min{y : p(l(y)) = p(l(x)),B((p(p(l(x))),p'(p(l(x))},x, y, q, n)} 

Here p(p(l{x)) is a program and p'(p(l(x)) is a number of session; min is considered for 
lexicographical ordering of strings; we suppose that min0 is undefined. 
Lemma 2 For each computable operation Fi and for each finite sequence x such that 
F(uj) G ft for some infinite extension u of x (i.e., x C uj), (3(x,q,n) is defined for all 
sufficiently large n such that p(p(n)) = i. 

Proof. The needed sequence y exists for all sufficiently large n, since l(Fi(u> n )) > (x,s) 
holds for all sufficiently large n, p(n) = (i, s). A 

The goal of the construction below is the following. Each extra edge a will be assigned 
to some task number / = (i, s) such that p(l(st(cr))) = p(l{ter{a))) = I. The goal of the 
task / is to define a finite set of extra edges a such that for each infinite binary sequence 
uj one of the following conditions hold: either uj contains some extra edge as a subword, or 
the network flow delay function d equals 1 on some initial fragment of uj. For each extra 
edge o~ added to the network q, B(I,st(a),ter(a),q n ^ 1 ,n) is true; it is false, otherwise. 
Lemma 5 shows that Q(Eq) > 1 — e, where Q is the g-fiow and Eq is its support set. 

Construction. Let p(n) = (n + n ) 2 for some sufficiently large no (the value no will 
be specified below in the proof of Lemma 5). 

Using the mathematical induction by n, we define a sequence q n of elementary net- 
works. Put q°(a) = 1/2 for all edges a of length one. 

Assume n > and a network q"" 1 is defined. Let be the g n_1 -delay function 

and let G" _1 be the set of all extra edges. We suppose also that l(ter(a)) < n for all 

Let us define a network q n . At first, we define a network flow delay function d n and a 
set G n . 

Let w(I, q 11 ^ 1 ) be equal to the minimal m such that p{m) = I and m > l(ter(a)) for 
each extra edge a € G™ -1 such that p(l(st(a) j) < I. 

The inequality w(I,q m ) ^ w(I,q m ^ 1 ) can be induced by some task J < I that adds 
an extra edge a = (x, y) such that l(y) > w(i, q" 1 ^ 1 ) and p{l{x)) = p{l{y)) = J- Lemma 3 
(below) will show that this can happen only at finitely many steps of the construction. 

The construction can be split up into three cases. 

Case 1. w(p(n),q n ^ 1 ) = n (the goal of this part is to start a new task / = p(n) or 
to restart the existing task / = p{n) if it was destroyed by some task J < I at some 
preceding step). 
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Put d n (y) = l//?(n) for l(y) = n and define d n (y) = d n 1 (y) for all other y. Put also 
G n = G n-i_ 

Case 2. w{p{n) 1 q n ^ 1 ) < n (the goal of this part is to process the task I = p(n)). 

Let C n be the set of all x such that w(I,q n ^ 1 ) < l(x) < n, < d n ~ 1 (x) < 1, the 
function /3(x, g n_1 , n) is defined 3 and there is no extra edge a G G™ -1 such that 
st(a) = x. 

In this case for each x 6 G„ define d n ((3(x, g n_1 , n)) = 0, and for all other y of length 
n such that x C y define 

<T(y) =d"- 1 (x)/(l-d"- 1 (x)). 
Define = d n ^ 1 (y) for all other y. We add an extra edge to G™ _1 , namely, define 

G" = G"- 1 U {(z./Jfog"" 1 .^) : a: £ C„}. 

We say that the task 7 = p(n) adds the extra edge (x,(3(x, n)) to the network 
and that all existing tasks J > I are destroyed by the task /. 
After Case 1 and Case 2, define for each edge a of unit length 

q n (a)= 1 -(l-d n (st(a))) 

and q n (a) = d n (st(a)) for each extra edge a £ G™. 
Case 3. Cases 1 and 2 do not hold. 
Define d n = cf 1 " 1 , = <7™~\ G™ = G™ -1 . 

Using this construction, we define the network q = lim q n , the network flow delay 

n^oc 

function d = lim cP, and the set of extra edges G = U„G". 

The functions q and d are computable and the set G is recursive by their definitions. 
Let Q denote the g-flow. 

The following lemma shows that any task can add new extra edges only at finite 
number of steps. 

Let G(I) be the set of all extra edges added by the task J, w(I, q) = lim^oo w(I, q n ). 
Lemma 3 The set G(I) is finite and w(I, q) < oo for all I . 

Proof. Note that if G(J) is finite for all J < / then w(I,q) < oo. Then we must prove 
that the set G(I) is finite for all /. Suppose that the opposite assertion holds. Let I be 
the minimal number such that G(I) is infinite. By choice of / the sets G( J) for all J < / 
are finite. Then w(I, q) < oo. 

By definition if d(oj m ) ^ then p m = l/d(uj m ) is a positive integer number. Besides, 
if (c<j™,y), (uj m ,y') G G(7), where n < m and l(y) = to, then p n > p m . Hence, for each 
uo G ft a maximal to exists such that (uj m ,y) G G(7) for some y or no such extra edge 
exists. In the latter case put m = w(I, q). Define u(u) = l/d{to m ). 

By the construction the integer valued function u(u) is constant on the interval T^™. 
Hence, it is continuous in the topology generated by such intervals. Since f2 is compact 
in this topology, u{u) is bounded. Then for some m', u(u) — u{uo m ) for all u. By 
the construction if any extra edge of 7th type was added to G(7) at some step then 
d{y) > d(x) holds for some new pair (x,y) such that x C y. This is a contradiction if 
G(7) is infinite. A 



3 In particular, p(l(x)) = I and l(/3(x,q n 1 ,n)) = n. 
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An infinite sequence a £ fl is called an I- extension of a finite sequence x if x C a and 
B(I, x, a n , n) is true for almost all n. 

A sequence a £ ft is called I- closed if d(a n ) = 1 for some n such that p(n) = /, where d 
is the g-delay function. Note that if a £ G(I) is some extra edge then B(I, st(a), ter(a),n) 
is true, where n = l(ter(o~)). 

Lemma 4 Assume for each initial fragment u n of an infinite sequence lu some I -extension 
exists. Then either the sequence u> will be I-closed in the process of the construction or 
lo contains an extra edge of Ith type (i.e. such that ter(o~) C u> for some a £ G(I)). 
Proof. Assume a sequence u> is not /-closed. By Lemma 3 the maximal m exists such 
that p(m) — I and d(td m ) > 0. Since the sequence w m has an /-extension and d{u k ) < 1 
for all k, by Case 2 of the construction a new extra edge (cu m ,y) of /th type must be 
added to the binary tree. By the construction d{y) = and d(z) ^ for all z such that 
uj m C z, l(z) = l(y), and z y. By the choice of m we have y C u>. A 

Obviously, Q(y) — if and only if q{u) — for some edge a of unit length located on y 
(this edge satisfies ter(a) C y and d(st(aj) = 1). Then the relation Q(y) — is recursive 
and E Q = Sl\Ud(x)=\Fx- 
Lemma 5 It holds Q(Eq) > 1 — e. 

Proof. We bound Q(Q) from below. For any n, let q n be the network defined at step n, R n 
be defined by (A.l), and d n be the corresponding g™-delay function. If w(p(n), q 71 ^ 1 ) = n 
(i.e., Case 1 holds at step n) then 

J2 d n (u)R n (u) = (n + n )- 2 ^ R n (u) < (n + n )" 2 . (A.2) 

l(u)—n 

Assume Case 2 holds at the step n and x £ C n such that (x,y) £ G for some y, 
l(y) = n. Since by the construction d n {y) = 0, 

E d"(z)R"(z) < J j E W ( A - 3 ) 

l(z}-n,zC2 l(z)—n,xC.z,z^y 

We have 

E A"" 1 ^) < (l-(f ,_1 (a;))ir i - 1 (a;). (A.4) 

By the construction R n (z) — /?™ _1 (z) for z such that Z(z) — n, x £ z, z ^ y. Then 

^ d n {z)R n {z) < d n -\x)R n - 1 (x). (A.5) 

l(z}-n,a:C2 

By definition J2( n + n o) -2 < £■ After that, using (A.2) and (A.5) we can prove by the 
mathematical induction on n that 

Q(fi) = inf V Qlu) > inf V > 1 - e. 

l(u)—n l(u)—n 

Lemma is proved. A 

Lemma 6 For any infinite sequence u) £ Eq and for any computable operation F if the 
sequence F(ui) is infinite then it is not Martin-Ldf random with respect to the uniform 
probability distribution. 
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Proof. Assume that u is an infinite sequence and F is a computable operation such that 
F(u>) is infinite. Then Fi — F for some i. Define 

U s = U{r / j (a . )9 n-i in ) : x G C n ,p(n) = (i, s)}, 

where C n is the set from Case 2 of the construction. By definition 



for some positive constant c, and Fi{to) G (1 S U S . Therefore, the sequence F(u) is not 
Martin-L6f random. Lemma 6 and Theorem 3 are proved. A 
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